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1 A graphical user interface is provided which 
can create a predjcate for searchin g for data 
using only mouse op erations on the desktop, 
and apply the predicate to a database s ystem 
containing objects to be searched for. 

The user can identify a primitive predicate b y 
inputting search items (that is. file attributes) o n 
the desktop, and can create a logical operation 
expression for identif ying search conditions by 
display in g a composite predic ate representing 
a logical operator as a folder, and by dragging 
and dropping an icon re presenting fte^pre^dh 
cate on that folder. Then, the logical operation 
expression can be hierarchically organized and 
stored. Moreover, a predicate can be displayed 
on the desktop on a desired hierarchical level 
by opening or closing an icon for each compo- 
site predicate from an icon to a folder, or a 
folder to an icon. Then, a predicate can be 
applied as search conditions by drop ping an 
icon representin g the created predicate on a . 
folder representing a database (in this case, the 
dropped object of display becomes the search 
range) . Further, the predicate can be applied to 
the database by dropping an icon representing 
the database on a predicate icon (or, folder). 
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This invention relates to a graphical user inter- 
face for supporting interactive input by a user on a 
computer system and, more particularly, to a graphi- 
cal user interface which enables the user to input an 
intent by operating an icon through a mouse. 

Currently, a personal computer or workstation 
generally has a bit-map display and an operating sys- 
tem (such as OS/2 or Windows - trademarks of, re- 
spectively, International Business Machines Corpor- 
ation and Microsoft Corporation). It is known for a per- 
sonal computer or workstation to provide a user with 
a graphical user interface environment which com- 
prises a simulated desktop window and icons. 

Here, "desktop" means a screen on which the 
user performs activities, and a background on which 
objects such a s icons an d windows a re placed. "Icon" 
means a small picture representing a usable object, 
and is arranged to be placed on the desktop or on a 
window within the desktop. The icon can represent an 
application, a disk drive, a directory, a group, or a 
document. A "window" means a frame displayed on 
the desktop for displaying some objects. The window 
is generally standardized, and arranged to be able to 
provide common frames relating to various informa- 
tion processed by the user. Standard components of 
a window are a window title bar and a window bound- 
ary. The title bar is an area for displaying the title of 
an applicable window, with this title allowing identifi- 
cation of information (the object) currently displayed 
in the window. 

In addition, the user is usually provided with a co- 
ordinate selection device such as a mouse or track 
ball for selecting coordinate values and an input de- 
vice such as a keyboard. Then, the user can move 
windows around on the desktop, set their size, and 
manipulate them by dragging (an operation in which 
the mouse is moved while a mouse button is being 
pressed). Moreover, the user can view the contents of 
an object through a window by opening an icon by 
clicking with the mouse (an operation in which a 
mouse button is pressed and released), or can mini- 
mize an object being operated on to an icon. 

Further, it is well known in the art to hierarchically 
organize and store a plurality of created files by util- 
izing the directory or folder concept Furthermore, at 
present, the hierarchical organization and storage of 
a plurality of documents can be implemented through 
manipulation of an icon with the mouse by combining 
the document organization technique and the above- 
mentioned window displaying technique, which would 
be apparent to those skilled in the art. 

An example of the hierarchical organization of 
documents is described as follows: 

For example, as shown in Figure 1 S^is assumed 
t hat a plurality of files (that is, file 1, file 2, and file 3) 
are hierarchically organized in a file system incorpo- 
rated (or provi ded) in a computer system. As shown 
in Figure 15, fil es 1 and 2 are stored in a further sub- 



divided directory 1, and the file 3 is sto red in a further 
subdivided directory 2. Fjguy Tfris an example dis- 
playing hierarchical files on the deskto p. In Figure 16^ 
each filejfile 1, file 2, file 3) is displayed in the form 

5 of an icc fl as F1, F2 and F3. Here, folders 1 and 2 in 
Figure 16 correspond to directories 1 and 2 in Figure 
15. It is possible to clearly indicate by surrounding 
Ic ons F1 and F2 by an area framed by the folder 1 that 
files 1 and 2 are contained in the directory 1. Similar - 

10 ly, it is possible to clearly indicate by surrounding the 
icon F3 by an area framed by the folder 2 that the file 
3 is contained in the directory 2. 

In additio n, each folder can be identified by a title 
provided for the folder, and can be visually recognized 

is by changing the color of the area in the folder from 
that of the background . Furthermore , a folder dis - 
play ed on the desktop can be minimized to an icon by 
a predetermined mouse operation (for example, click- 
ing on a minimize-to-icon menu in a tSfflflfltP ( nr fl 

20 minimize-to-icon button on the title bar, not shown)) , 
or a minimized-to-icon folder can be opened by a pre- 
determined m ouse_operation_( for example, double - 
dicking of a mouse button on an appropriate icon 
( quickly pressin g the mouse button twice w ithout 

25 movjngJtoe^cijse^Mor 

file can be similarly opened by the mouse operation, 
ortheo pened f ile can be minimize to an icon. 

As shown in Figure 17, the user can move a mini- 
mized-to-icon file from one directory to another by 

30 dragging and dropping (releasing a continuously 
pressed mouse button) in a directory where the icon 
is placed (Figures 17 (a) and (b)). In addition, a mini- 
mized-to-icon file can be deleted from the file system 
by drag & drop on the shredder icon (not shown), just 

35 as an actual shredder shreds a form. 

As described above, the user can copy, move to 
another folder, and delete a predetermined file on the 
desktop via only mouse operation. In other words, the 
user can hierarchically organize a plurality of files by 

40 basic mouse operations such as drag & drop (this is 
already know by itself). Then, in each activity, the 
user need not understand a complicated program, but 
need only be aware of the presentation on the desk- 
top. 

45 Operations requested by the user for the organ- 
ized and stored file system include search for or re- 
trieval of a file in addition to the above. A file search 
is done by the user to identify a specific predicate a nd 
apply it to the file system (a predicate means one 

so such as "a file with a file size larger than 10,000 
bytes"). A conventional approach for identifying a pre- 
dicate is usually to display a panel on the desktop, and 
for the user to input a desired value (or a search item) 
in an attribute field of the panel. Then, the panel to be 

55 applied to the file search usually includes one or more 
attribute fields in which various file attributes such as 
ti le name , file type, file creation time, and most re- 
cent update time are input 
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In addition, p redicates identified by the user are 
of two types: 

primitive or atomic and composite. T he primitive pre- 
dicate is a minimum unit which contains at least one 
search item and cannot be divided. Details identified 5 
bv search items in attribu teiiel dson the panel relat ed 
to the predicate become search conditions. The com- 
posite predicate combines a plural rty of primitive pre - 
dicates and other composite predicates with logical 
operators such as AND. OR. and NOJ. The results of 10 
l ogical operations of search items in attribute fields in 
each primitive predicate become search conditions 
for files. It is possible to consider all entire predicates 
as having a hierarchical structure by representing 
each primitive predicate and composite predicate as 15 
one node, and representing other predicates, which 
are terms of logical operation related to some compo- 
site predicate, as a node immediately below the com- 
posite predicate. 

It is relatively easy for the user to identify a prim- 20 
"rtive predicate because it is sufficient tor the user to 
fill in attribute fields on the panel displayed on the 
desktop with the search items. However, it is not easy 
to identify a composite predicate because a plurality 
of keywords can be specified by a common search 25 
tool, but specification of AND or OR between key- 
words is performed only in a limited manner. 

For example, the DOS Office of Office Vi- 
sion/400 provides a document search tool as shown 
in Figure 1 8. This search tool en ables up to three key- 30 
words to be specified, and is designed to search for 
AND condition for each specified keyword (that is, to 
search only for documents containing all specified 
keywords). With such a search tool, it is impossible to 
make a complicated specification such as "docu- 35 
ments in either English or Japanese for the last single 
month, and those in Japanese only earlier than that" 
If it is desired to do such a search, it can only be done 
by repeating the similar search several times. 

An approach also exists to represent a composite 40 
predicate in the form of an aiflA^pir^yprp-ssinn such 
as _(A+ B) * C, in which attributes A, B, and C are 
joined by logical operators such as + and \ However, 
if the logical expression has many nested layers be- 
cause many attributes are to be combined, such al- 45 
gebraic expression becomes complicated and diffi- 
cult to understand to the user, and therefore it cannot 
be said to be easily understood by the user. 

Summary of the Invention so 

The present invention can operate on a computer 
system provided with a coordinate selection device 
such as a mouse for graphic pointers on a desktop, an 
enter key such as a mouse button, and support for 55 
displaying a plurality of windows. 

In a first aspect, the invention provides a graphi- 
cal user interface implemented in a computer system, 



which system includes a CPU, a display, a keyboard 
for console input, a mouse for selecting coordinate 
values, and storage for storing and managing one or 
more objects, the com p uter system being loaded with 
an operating system for controllin g the o peration of 
the CPU and a vyin dow Mapaper supporting display 
of objects on the display, wherein the graphical user 
injprfa^a comprises: 

(a) a pmflpate fraatinn fiertjp" for creating pre- 
dicates for searching for desired objects in stor- 
age; 

(b) a predicate organization/storage section for 
hierarchically organizing and storing created pre- 
dicates; and 

(c) a predicate application section for applying 
stored predicates to one or more objects in stor- 
age. 

The present invention thus preferably provides a 
graphical u ser interface flJ|owi n Q *ha iispr tn easily 
i dentify a c omplicated predicate 

The invention preferably provides an excellent 
graphical user interface which allows the user, using 
only coordinate selection (e.g. mouse) operations on 
the desktop, to create a predicate for searching for 
data, and to apply that predicate to a database system 
containing objects to be searched for. The invention 
thus preferably provides a graphical user interface 
enabling the user to set, by operating a mouse, a pre- 
dicate for use in retrieving desired objects from a da- 
tabase, which stores and manages a number of ob- 
jects, and filters and reads them. Here, the reference 
to "objects" to be retrieved is intended to include va- 
rious files such as text files and name files, and inn- 
age and other multimedia data. 

In a preferred embodiment , the predicate crea- 
tion section includes: 

(a) a primitive predicate creation section for cre- 
ating an indivisible primitive predicate containing 
search Hems; and 

(b) a composite predicate creation section for cre- 
ating a composite predicate which consists of a 
logical operation for one or more predicates. 
The predicate organization/storage section is to 

organize and store one or more predicates in a form 
combining them with each other by one or more log- 
ical ope rat tons, and arranged to prepare a data block 
corresponding to each predicate created by the prim- 
itive creation section and the composite creation sec- 
tion. In addition, the predicate organization/storage 
section is to organize and store one or more predi- 
cates in a form combining them by one or more logical 
operations, and is arranged to hierarchically organize 
and store predicates in such a manner that a second 
predicate (provided the second predicate is a compo- 
site predicate) for forming logical operations between 
first predicates (provided the first predicate is a prim- 
itive predicate or a composite predicate obtained in 
previous logical operation on other predicates) is 
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placed at a level immediately above the first predi- 
cates. 

The predicate applicatioQ section preferably in- 
cludes: 

(a) a primitive predicate application section for 5 
applying a primitive predicate to the object in the 
storage; and 

(b) a composite predicate application section for 
applying a composite predicate to objects in stor- 
age. 10 
The primitive predicate creation section, the com- 
posite creation section, the primitive predicate appli- 
cation section, and the composite predicate applica- 
tion section are preferably enabled to operate in re- 
sponse t o drag & drop notification via the mouse from 15 
the Window Manager. 

The predicate creation section preferably sends 
to the Window Manager c ommands f or displayin g a 
composite predicate on the desktop as a folder, or 
presenting a primitive predicate and a composite pre- 20 
dicate as the respect ive ic ons. 

As described in the Prior Art, the user ca iLbuild 
a d atabase in which a plurality of files is hierarchically 
organized by only mouse operation which drags and 
drops a n icon corresponding to a file (object) inside 25 
or outside a folder corresponding to a directory. This 
is well known by itself. 

In addition, according to the present invention, 
the user can identify a primitive predicate by inputting 
search items (that is, file attributes) on the desktop, 30 
and create a logical operation expression for identi- 
fying search conditions by presenting, as a folder, a 
composite predicate representing a logical operator, 
and dragging and dropping a n icon re presenting a 
p redicat e in the folder. Then, the logical operation ex- 35 
pression can be hierarchically organized and stored. 

The entire pred icate for identifying search cond i- 
tions frequently generates deeper nesting in which 
predicates are combined by other logical operators. In 
this case, it becomes complicated and difficult to un- 40 
derstand if it is expressed as an ordinary algebraic ex- 
pression. 

However, the present invention provides excel- 
lent operability because a predicate can be displayed 
on the desktop at the desired hierarchal level. 45 

Then, the created predicate can be applied as a 
search condition by dropping an icon representing the 
predicate on a folder (or icon) representing a data- 
base, provided that the folder object on which it is 
dropped is the search range. Furthermore, a predi- so 
cate can be applied to a database by dropping an icon 
representing the database on a predicate icon (or 
folder). 

Thus, the user can create a prgdicaje b y icon ma- 
nipulation on the desktop without having to under- 55 
stand details of a complex program, and applies it to 
a file system which is hierarchically organized and 
stored. 



Further objects, features, and advantages of the 
present invention will be made clear from the follow- 
ing detailed description based on an embodiment and 
the attached drawings. 

Description of Preferred Embodiment 

An embodiment of the present invention will now 
be described in more detail, by way of example, with 
reference to the accompanying drawings in which: 
Figure 1 is a schematic diagram of the configur- 
ation of a computer system used for implement- 
ing the present invention; 
Figure 2 a schematic diagram of the configura- 
tion of a Predicate Manipulation System related 
to an embodiment of the present invention; 
Figure 3 is a diagram showing a data structure 
used for an embodiment of the present invention, 
wherein Figure 3 (a) is a diagram showing the 
configuration of a data block of a primitive predi- 
cate, and Figure 3 (b) is a diagram showing the 
configuration of a data block of a composite pre- 
dicate; 

Figure 4 is a diagram showing an edited final pre- 
dicate, wherein Figure 4 (a) represents the predi- 
cate in the ordinary form of logical expression, 
Figure 4 (b) represents the predicate shown in 
Figure 4 (a) in a tree structure, Figure 4 (c) rep- 
resents an example of the predicate shown in Fig- 
ure 4 (a) displayed on the desktop, and Figure 4 
(d) represents the predicate shown in Figure 4 (a) 
in the form of data block; 
Figure 5 is a conceptual diagram showing the co- 
operative operation between the Predicate Ma- 
nipulation System and the Window Manager in 
creating a predicate; 

Figure 6 is a conceptual diagram showing the co- 
operative operation between the Predicate Ma- 
nipulation System and the Window Manager in 
further modifying or correcting the created predi- 
cate; 

Figure 7 is a conceptual diagram showing the co- 
operative operation between the Predicate Ma- 
nipulation System and the Window Manager in 
performing a search by the created predicate; 
Figure 8 is a conceptual diagram showing what 
happens when a predicate icon is dropped on an 
object to be searched; 

Figure 9 is a conceptual diagram showing the co- 
operative operation between the Predicate Ma- 
nipulation System and the Window Manager in 
performing a search by the crated predicate; 
Figure 10 is a conceptual diagram showing what 
happens when the object of application is drop- 
ped on the predicate icon; 
Figure 11 is a diagram showing basic mouse op- 
erations which the user may use on the desktop, 
and specifically a diagram showing an operation 



15 



20 



25 



30 



35 



40 



45 



4 



7 



EP0 667 585 A1 



8 



for moving an icon from one folder to another; 
Figure 12 is a diagram showing basic mouse op- 
erations which the user may use on the desktop, 
and specifically a diagram showing how a com- 
posite predicate is displayed; s 
Figure 13 is a diagram showing basic mouse op- 
erations which the user may use on the desktop, 
and specifically a diagram showing creation of a 
composite predicate; 

Figure 14 is a diagram showing basic mouse op- 10 
erations which the user may use on the desktop, 
and specifically a diagram showing creation of a 
composite predicate; 

Figure 15 is a diagram showing the configuration 
of files hierarchically organized in a file system 15 
incorporated in a computer system; 
Figure 16 is a diagram showing an example of hi- 
erarchically organized files on the desktop; 
Figure 17 is a diagram showing an operation for 
moving a minimized- to-icon file from one directo- 20 
ry to another by drag & drop; and 
Figure 18 is a diagram showing a screen display 
of a document search tool provided by the DOS 
Office of Office Vision/400. 

The description includes the followng sections: 25 

A. System Configuration 

B. Window Manager 

C. Basic Desktop Mouse Operations 

C-1. Icon movement from one folder to another 
C-2. Expression of composite predicate 30 
C-3. Creation of composite predicate (part 1) 
04. Creation of composite predicate (part 2) 

D. Predicate Manipulation System 
D-1. Predicate data structure 

D-2. Creation of predicate 35 
D-2-1. Creation of primitive predicate 
D-2-2. Creation of composite predicate 

(I) Creation of composite predicate by icon drag 
& drop 

(II) Creation of composite predicate by WRAP op- 40 
eration 

D-3. Organization and storage of predicate 
D-4. Application of predicate 
D-4-1 . Dropping of predicate icon on object to be 
searched 45 
D-4-2. Dropping of icon to be searched on predi- 
cate icon 

A. System Configuration 

50 

Fiqjjmjl shows the schematic configuration of a 
computer system (1 0) to be used for implementing the 
present invention. That is, the system (10) has such 
a configuration in which a typical personal computer 
or workstation comprising a CPU (11), a file system 55 
or d atabase system (12 V a display (13), a keyboard 
(14), and a mouse (15) supports an operating system 
(16), a Window Manager (1 7), and an application pro- 



gram (1 8). The CPU (11 ) is usually configured by a mi- 
croprocessor, RAM, and ROM. The database system 
(12) is a section which stores a plurality of objects to 
be searched such as files consisting of text, name 
files, and multimedia data such as images, and can 
be accessed by the application program (1 8). The op- 
erating system (16) is a section in which programs for 
controlling the operation of the CPU (11) are concen- 
trated and to which OS/2 (OS/2 being a trademark of 
IBM) or the like corresponds. The Window Manager 
(17) is a section which supports various service func- 
tions, which will be described later, for the application 
program (18), and to which the Presentation Manger 
(PM) provided in OS/2 or the like corresponds. The 
application program (18) is a section where the vari- 
ous application programs executed by the CPU (11) 
are placed and which includes as one of these the 
Predicate Manipulation System (20) used for imple- 
menting the present invention. 

B. Window Manager 

Service functions provided by the Window Man- 
ager (17) to ap plication programs (especially, to the 
Predicate Manipulating System) include the follow- 
ing: 

(1) Display nf jrj anu- and notification of selection by 
mouse: 

This function displays, at a predetermined posi- 
tion on the desktop, a menu which lists commands 
available for an application program currently sup- 
ported by the Window Manager (not shown), and 
_ which notifies the a pplication program of selection of 
a command in the list bv the user clic kin g or otherwise 
seje^ingjbyjhe-moujse.. 

In the case of the Predicate Manipulation Sys - 
tem! the menu has various cgrnrnands such as QBE- 
ATE PRIMITIVE (creation of a primitive predicate) , 
CLOSEDlminimizinq an object). CRE ATE FOLDER 
(cr eation of a folder), WRAP (surrounding icons with 
a folder), and UNWRAP (removing a folder), all of 
which are not shown. 

(2) Cre ation and displaying of icon and folder 

The rn ej u on the desktop is prepared with items 
as available commands corresponding to icon crea- 
jfo n. folfler creation, and the like. Then, this function 
is to notify the application program of selection of an 
item by clicking or otherwise selecting by the mouse 
(the application program creates an icon or folder at 
the initial state, that is, the blank state in a data block, 
described later), and to display a corresponding icon 
or folder on the desktop. 
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(3) Notification of icon movement to application 
program accompanying drag & drop 

It is possible to appropriately move an object (that 
is, icon or folder) displayed on the desktop to a de- 5 
sired position by drag & drop. Then, with this function, 
a coordinate location where an icon is dropped is re- 
ported to the application program. 

(4) Icon insertion and deletion in folder 10 

With the function (3), an icon can be freely moved 
on the desktop, or dropped into a folder. This function 
displays an icon inside a folder in response to receipt 
of a signal by the application program, the signal 15 
which represents dropping of an icon in a folder (cor- 
responding to nesting of an object corresponding to 
the icon in an object corresponding to the folder at the 
application program side). In addition, as described in 
the Prior Art, a function is also provided to delete dis- 20 
play of an icon if the icon is dropped on the shredder 
icon. 

(5) ^Notif ic ation of selection of ic on in falser by 

rpousft to application: 25 

This function notifies the application program of 
icon selection inside a folder by the user clicking or 
otherwise selecting by the mouse. 

30 

(6) Enumeration of icons in folder 

This function enumerates, as a list, icons nested 
in a folder, and sequentially sends them out For ex- 
ample, this is used to pass icons in a folder one after 35 
another, described later. 

(7) Icon attribute setting, modification, and inquiry: 

Each icon displayed on the desktop has unique 40 
attributes such as graphics and locations. This func- 
tion sets, modifies, and inquires about icon attri- 
butes. 

(8) Display of panel for primitive predicate and 45 
modification of panel contents 

As described in the Prior Art, a primitive predicate 
is identified by writing search items in the attribute 
field on the panel displayed on the desktop. This fu no 50 
tion displays a panel related to a primitive predicate 
on the desktop, or modifies its contents in response 
to the creation or modification of the primitive predi- 
cate. 

Such functions (1) - (8) of the Window Manager 55 
are existing ones. For example, the Presentation 
Manager (PM) included in OS/2 has these functions. 

In this embodiment for convenience sake, the 



Window Manger (17) is divided, as shown in Figures 
5 to 7, into a menu display/selection section (91), a 
drag & drop notification section (92), a folder display 
section (93), an icon display section (94), a panel dis- 
play/modification section (95), and a folder content 
enumeration section (96), which together handle 
functions (1)-(8). 

C. Basic Desktop Mouse Operations 

Basic mouse operations which the user may per- 
form on the desktop are described below. 

C-1. Icon movement from one folder to another 

As shown in Figure 11, it is assumed that Folder 
1 contains icon 1 (F1) and icon 2 (F2), and Folder 2 
contains icon 3 (F3). If it is desired to move an object 
relating to icon 2 (F2) from Folder 1 to Folder 2, the 
user need only drag icon 2 (F2) and to drop it on Fold- 
er 2. The display on the desktop changes accordingly. 

C-2. Expression of composite predicate 

Figure 12 shows how a composite predicate is 
displayed on the desktop. 

For example, Pi n P 2 n P 3 is created by entering ob- 
jects P 1t P 2 , and P 3 in an AND folder (the same being 
true for other OR and NOT folders). 

C-3. Creation of composite predicate (part 1) 

As shown in Figure 13, first, a folder correspond- 
ing to a desired logical expression (in the figure, AND) 
is created by a menu command on the desktop (not 
shown). Then, only icons desired for use in building 
the logical expression are selected from those out- 
side the folder (in the figure, P, and P2), and dragged 
and dropped in the folder. The display on the desktop 
changes accordingly. 

C-4. Creation of composite predicate (part 2) 

Icons desired to be incorporated in a logical ex- 
pression are selected (by clicking) from one or more 
icons on the desktop. Then, items appropriate for de- 
sired logical operators are selected from menu com- 
mands (not shown). In Figure 14, icons P 3 and P 4 are 
selected from icons P, , P 2 , P 3 » P* Ps. and P* and built 
into a logical relationship by an AND folder. 

D. Predicate Manipulation System 

The application program (18) is a collection of 
programs executed by the CPU (11), as described 
above. The application program includes application 
programs which access the database system (12) 
and process data stored therein such as data search, 
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data compression, and data conversion. Moreover, 
the data search program includes as one component 
the Predicate Manipulation System (20) used for im- 
plementing the present invention. 

Figure 2 s hows an outline of the configuration of 5 
P redicate Manipulating System (20) . The Predicate 
"Manipulation System (20) is further divided into three, 
that is, a predicate creation subsystem (30) for sup- 
porting activities of the user to create a predicate on 
the desktop, a predicate organization/storage sub- 10 
system (40) for organizing and storing a final predi- 
cate for th e desired search by organizing individual 
created primitive and composite predicates, and a 
predicate applicati on subsystem (50) f or applying or- 
ganized composite predicates to the file system. 15 

D-1. Predicate data structure 

Figure ^ shows a data structure u sed by this em- 
bodiment (particularly, the Predicate Manipulation 20 
System (20)), Figure 3 (a) showing the structure of 
the data block for the primitive predicate (60), and Fig- 
ure 3 (b) showing the structure of the data block for 
the composite predicate (70). 

The data block for the primitive predicate (60) in- 25 
eludes a type field (6 1), a pointer (62) to a next sibling, 
a status field (63 ). a data type field (64 ), and a n .at- 
t ribute field (65), Furthermore, the data block for the 
composite predicate (70) includes atvpefield^7 1V a 
pointe r (72) to a next sibling, , a status field ( 73). and 30 
a pointer (74) to the first child data block. 

Fields at the first to third levels of both data blocks 

(60) and (70) have a common structure. Type fields 

(61) and (71) are used to determine whether a predi- 
cate is primitive or composite. If it is primitive, PRIM- 35 
ITIVE or data equivalent to it is written. If it is compo- 
site, one logical operator amnn g AND Qp t or NOT is 
written. Pointers (62) and (72) to next siblings point to 

a storage location of a data block associated with 
each other as the same level in the organized hier- 40 
archical structure (that is, a next sibling). Status fields 
(63) and (73) indicate the displayed state of the pre- 
dicate on the desktop. OPEN being written if the ob- 
ject is open, while CLOSED being written if it is mini- 
mized to an icon. 45 

ThArifltf* typo f iold (64) identifies the type of data 
to be applied with a predicate. Types which may be 
used include a file, a register of names, and multime- 
dia data such as images. The attribute field (65) is the 
search item which a preplicate actually identifies. At- so 
tributes which can be input depend somewhat on the 
type specified in the data type field (64). For exam- 
ple, if the data type is a file, attributes which can be 
selected includes the creation date, its size, and the 
owner of the file. If the data type is a register of 55 
names, attributes which can be selected includes a 
person's name, the birth date, a telephone number, 
and hobby. The pointer to the first child data block 



(74) at the bottom of the data block for the composite 
predicate (70) points to the storage location of a data 
block coupled to one immediately below it in the or- 
ganized hierarchical structure. Why only a data block 
relating to a composite predicate has the pointer to a 
child data block (74) may be understood by taking into 
consideration the fact that a primitive predicate be- 
comes only the end (or leaf) of the hierarchical struc- 
ture, while a composite predicate cannot become the 
end (or leaf) of the hierarchical structure (it has an- 
other composite predicate or a primitive predicate in 
its lower level). 

Figure 4 illustrates an organized final predicate. 

Figure 4 (a) expresses it as a form of ordinary log- 
ical expression. That is, it contains four primitive pre- 
dicates P1, P2, P3, and P4, and takes a logical prod- 
uct between the logical sum of P1 and P2, and that 
of P3 andP4. 

Figure 4 (b) represents the predicate shown in 
Figure 4 (a) in a tree structure. That is, an AND node 
corresponding to the logical product becomes the top 
level, an OR node corresponding to each term of the 
AND operation is coupled immediately below the AND 
node, and P1 and P2 f or P3 and P4 corresponding to 
each term of each OR operation are coupled imme- 
diately below respective OR nodes. 

Figure 4 (c) is an example of the predicate shown 
in Figure 4 (a) which is displayed on the desktop. Be- 
cause the status of AND, which is a logical product of 
two corresponding to this predicate, is OPEN, an ob- 
ject on the desktop corresponding to this predicate is 
displayed as an AND folder, in the region of which 
each object corresponding to OR, which is a node im- 
mediately below, is displayed. Because the logical 
sum OR of P1 and P2 has OPEN as its status, an ob- 
ject corresponding to this predicate is displayed as an 
OR folder, in the region of which icons corresponding 
to P1 and P2 are displayed. Moreover, because the 
logical sum OR of P3 and P4 has CLOSED as its sta- 
tus, it is minimized to an icon. It is a matter of course 
that the status of a minimized-to-icon composite pre- 
dicate can be changed to OPEN by double-clicking on 
the icon to display it as a folder, or the status of a com- 
posite predicate displayed as an folder can be 
changed to CLOSED to make it an icon. Furthermore, 
although a primitive predicate is displayed as an icon 
in a folder (that is, its status is CLOSED), if it is 
changed to OPEN by clicking, it is displayed as a pan- 
el containing an attribute field, described later. 

Figure 4 (d) represents the predicate shown in 
Figure 4 (a) in a form of layered data blocks. The top 
data block (81) corresponds to AND, and has "nil" in 
its next sibling pointer because it has no next sibling 
in a layer on the same level. Its child pointer points to 
a data block OR (82) immediately below. The next sib- 
ling pointer of the data block (82) points to a data 
block OR (83) which is another term of an AND oper- 
ation, whereby both data blocks (82) and (83) are in- 
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dicated to be on the same level in the hierarchy. The 
child pointer of the data block (82) points to a data 
block (84) relating to the primitive predicate P1 as a 
data block immediately below. The next sibling poin- 
ter of the data block (84) points to a data block (85) s 
relating to P2, which is another term of an OR opera- 
tion. Moreover, because there is no term of an OR op- 
eration relating to a data block (82) other than P1 and 
P2, the next sibling pointer of the data block (85) 
points to "nil." Also, the data block (83) forms a similar 10 
connection relationship with data blocks (86) and (87) 
derived from it. The status field of each data block 
substitutes for a value corresponding to Figure 4 (c). 
That is, a data block on the same level in the hierarchy 
can be registered as new by connection with the next 15 
sibling pointer. A data block on a lower level can be 
newly registered by connecting a child pointer. 

With the above description, it can be fully antici- 
pated that even a predicate created by logical opera- 
tors in a complex manner can be represented by the 20 
data structure shown in Figure 3. 

The predicate organization/storage subsystem 
(40) stores and controls predicates in the data struc- 
ture (layered data block) shown in Figure 4 (d), descri- 
bed later. 25 



D-2-1. Creation of primitive predicate 

First, the operation creating a primitive predicate 
is considered. 

The user selects CREATE PRIMITIVE from the 
menu displayed on the desktop (by clicking). A menu 
display/selection section (91) notifies the primitive 
predicate creation/modification section (31) of the 
this selection operation. In response to this, the prim- 
itive predicate creation/modification section (31) pre- 
pares one data block for a primitive predicate (Figure 
3 (a)), and prompts the panel display/modification 
section (95) to display the panel on the desktop. The 
user inputs attributes (c onditions to search for a key- 
word) In the attribute field in the panel. Then, the at- 
tributes input on the screen are written to an applica- 
ble field in the data block through the primitive predi- 
cate creation/modification section (31). The complet- 
ed data block is temporarily held as a unit in the prim- 
itive predicate creation/modification section (31), and 
incorporated in another layered data block in the pre- 
dicate organization/storage subsystem (40) in subse- 
quent operation, described later. 

D-2-2. Creation of composite predicate 



D-2. Creation of predicate 

r refitifffl a prf^ti^te means to crate individual 
primitive predicates and composite predicates for a 30 
predicate for searching a data b ase, and is handled by 
the predicate creation subsystem <30). The predicate 
creation s^cyctom f * n ) is further ^jy j fledinto a prim- 
itive predicate creation/modification section (31) and 
a composite predicate creation/modification section 35 
(32). 

The primitive predicate creation/modification 
section ( 31 ) creates one data block related to a prim- 
itive predicate in response to the user selecting, the 
CREATE PRIMITIVE-Command in the . r ng nu bv a 40 
mouse operation, and incorporates it at a predeter- 
mined location in a hierarchic al pre dicate stor ed in the 
p redicate organization/storage subsystem. The com - 
posite predicate creation/modification s ection (32 ) 
creates one data block related to a composite predi- 45 
cate in response to the us er selecting the CREATE 
FOLDER command in the meny bv a mouse-ODeta- 
t ion, and incorporates it at a predetermined level in 
the predicate sto rejdJn_the_predicate_organiza- 
tion/storag e subsystem ( 40). 50 

Fio"" i5jg « ranrp ptual diagram showing the co- 
operative operation between the F^fifljcat e Manipula- 
tion System an d the Window Mapager i n creating a 
ppftHiratg, The procedure for creating a predicate is 
described based on this figure. 55 



The operation for creating a composite predicate 
is considered next 

A composite predicate is created two ways: (I) 
drag & drop of icons with the mouse and (II) using the 
WRAP command in the menu. 

(I) Creation of composite predicate by icon drag & 
drop 

It is a prerequisite that, on the desktop, are fold- 
ers representing desired composite predicates such 
as AND, OR, or NOT. (In the case where a new folder 
is created because a desired composite predicate is 
not on the desktop, it is created by selecting CREATE 
FOLDER in the menu, which is reported to the com- 
posite predicate creation/modification section (32), 
which prepares one corresponding data block (Figure 
3 (b)) and causes a folder display section (93) to dis- 
play the folder.) 

The user moves an icon to be contained in the 
folder (that is, an icon representing a predicate to be 
made a term of a logical operation expression related 
to the folder) inside the folder by drag & drop. How- 
ever, it may be obvious from the preceding descrip- 
tion that the icon to be moved may be an icon of a 
primitive predicate or another composite predicate 
(or, folder) minimized to an icon. The drag & drop no- 
tification section (92) detects from a coordinate indi- 
cation signal (not shown) from the mouse which icon 
has been moved from which folder to which folder, 
causes the folder display section (93) and the icon 
display section (94) to update the display on the desk- 
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top, and notifies the composite predicate crea- 
tion/modification section (93). 

In response to this notification, the composite 
predicate aeation/modification section (93) appro- 
priately connects pointers between each data block 
to form a new parent-child relationship between the 
destination folder and the icon moved to it 

(II) Creation of composite predicate by WRAP 

The user selects one or more icons on the desk- 
top to make terms of a logical operation expression 
such as AND, OR, or NOT (however, the icon may cor- 
respond to either a primitive predicate or another 
composite predicate). The selection is made by col- 
lecting icons in a predetermined rang e with clicking or 
drag & drop. 

Then, the user selects WRAP in the menu, and 
specifies the type of logical operation. WRAP creates 
a new folder surrounding icons. The selection of this 
command is reported to the composite predicate cre- 
ation/modification section (32), and prompts the fold- 
er display section (93) to display the folder. Then, it 
prepares one data block corresponding to this folder 
(Figure 3 (b)), and establishes the desired logical op- 
eration expression by connecting data blocks related 
to the surrounded icons with pointers. 

Data blocks related to the folder created by either 
method (I) or (II) are temporarily held in the composite 
predicate creation/modification section (32), and in- 
corporated in the layered data block in the predicate 
organization/storage subsystem (40), described later. 

D-3. Organization and storage of predicate 

Organization and storage of predicates means to 
hierarchically organize and store primitive and com- 
posite predicates individually created in D-2, or to re- 
organize stored layered predicates. 

Figure 6 is a conceptual diagram showing the co- 
operative operation between the Predicate Manipula- 
tion System and the Window Manager in further mod- 
ifying or correcting the predicate. Modification and 
correction herein referred to include (I) modifying an 
attribute value specified by a primitive predicate and 
(II) modifying the parent-child relationship between 
data Mocks. 

(I) Modifying an attribute value specified by a 
primitive predicate 

First, a minimized-to-icon primitive predicate is 
made OPEN by double-clicking or the like and dis- 
played on a panel on the desktop. Then, search items 
in the attribute field on the panel are modified by input 
through the keyboard, and minimized again to an 
icon. In response to this, the primitive predicate cre- 
ation/modification section (31) prompts the predicate 



organization/storage subsystem (40) to modify the 
attribute value corresponding to the primitive predi- 
cate. 

s (II) Modifying the parent-child relationship between 
data blocks 

Modification of the parent-child relationship be- 
tween data blocks means to cancel or newly organize 

10 a parent-child in the hierarchy by moving a data block 
below a certain data block to a level below another 
data block, or by deleting a folder. 

A parent-child relationship is canceled one of two 
ways: dragging or UNWRAP. 

15 Dragging removes the desired icon from the fold- 
er and is reported to the composite predicate crea- 
tion/modification section (32) by the drag & drop no- 
tification section (92). In response to this, the compo- 
site predicate creation/modification section (32) 

20 prompts the predicate organization/storage subsys- 
tem (40) to detach the data block corresponding to the 
icon from the child pointer of the data block corre- 
sponding to the folder. 

UNWRAP is selected in the menu, and this is no- 

25 tified to the composite predicate creation/modifica- 
tion section (32). In response to this, the composite 
predicate creation/modification section (32) prompts 
the folder display section (93) to remove display of the 
folder for which UNWRAP is instructed. In addition, 

30 the composite predicate creation/modification sec- 
tion (32) prompts the predicate organization/storage 
subsystem (40) to delete the data block correspond- 
ing to this folder, and to shortcut the data block imme- 
diately below it and the data block immediately above 

35 it by a pointer. 

Furthermore, the parent-child relationship is cre- 
ated by dropping the icon being dragging into a de- 
sired folder. The drag & drop notif ication section (92) 
notifies the composite predicate creation/mod if ica- 

40 tion section (32) of which folder the icon is moved 
from and which folder is the destination of drag & 
drop. Dragging outside the folder is as described 
above. Then, when the icon is dropped into the folder, 
the composite predicate creation/modification sec- 

45 tion (32) establishes a new parent-child relationship 
by connecting the child pointer of the data block cor- 
responding to the folder to the data block of the icon 
(or, adding it to the next sibling of the data block re- 
lated to another icon in the folder). 

so Thus, the finally obtained predicate is stored in 
the predicate organization/storage subsystem (40), 
but may be stored in a disk, diskette, memory card, 
ROM, or another memory device, or copied to RAM 
for computer execution. 

55 

D-4. Application of predicate 

Application of a predicate searches for an object 
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satisfying the predicate in a database by using the 
predicate stored in the predicate organization/storage 
subsystem (40), and is handled by the predicate ap- 
plication subsystem (501 The predicate application 
subsystem (5p) is further divided into a ppmith/ft pre- 
dicate application section (51). a c ornpqstte-erfidicafe 
c a pplication section ^ 52 ). and a folder manipulation 
section (53). The primitive predicate application sec- 
tion (51) is arranged to reference data blocks relating 
to a desired primitive predicate from the predicate or- 
ganization/storage subsystem (40), to ^plyJbem to 
an ghject to Hp <w>amhAH fnr and outpuLe ither "true" 
or "false" wh ether it satisfies the predicat e. Also, the 
composite predicate application section (52) is ar- 
ranged to reference data blocks related to a desired 
composite predicate from the predicate organiza- 
tion/storage subsystem (40), if the data block imme- 
diately below is a primitive predicate, to have the 
primitive predicate application section (51) apply it, if 
the data block immediately below is further a compo- 
site predicate, to recursively process that lower pre- 
dicate, and to output either "true" or " falsel bv logical- 
ly operating on all outputs of lower predicates. The 
folder manipulation section (53) is arranged to se- 
quentially fetch objects from the folder to which the 
predicate is applied, and to pass them to the respec- 
tive predicate application sections (51) and (52). 

The application of a predicate is instructed one of 
two ways: dropping an icon corresponding to the pre- 
dicate on an object (folder or icon) corresponding to 
the database (subject of search) on the desktop (D- 
4-1 , described later) or dropping an icon correspond- 
ing to the database on an object corresponding to the 
predicate (D-4-2, described later). 

D-4-1. Dropping of predicate icon on object to be 
searched 

In this case, the predicate rs applied to an object 
(folder) subject to search specified by drop, and only 
objects (folders) satisfying the predicate are obtained 
as output Figure 7 is a conceptual diagram showing 
the cooperative operation between the Predicate Ma- 
nipulation System and the Window Manager in per- 
forming a search in this case. The description is 
based on the figure. 

First, the user drags and drops a predicate icon 
on an object (folder) subject to a search to which ap- 
plication is intended. Then, the drag & drop notifica- 
tion section (92) reports which predicate is dropped 
on which search subject of the folder manipulation 
section (53). Thus, the object upon which the predi- 
cate icon is dropped becomes the search range. The 
folder manipulation section (53) prompts the folder 
display section (93) to change displays of the back- 
ground color for the dropped folder or the like. 

TherKjhe folder manipulation section (S3) fefrnh- 
es individual objects (files) from the object (folder) 



subject to_seapcl), ^nd^sses^efTHo4he^ed!^lte_ 
^apnjif^tio" <M***»ng (*1) and-(52). I fthe predicate is 
primitive, it is passed to the primitive^ tedicate applh 
catloii-section-(51) . which in t urn_r eturns a r es ujt of 

5 (rue or false . However, if the predicate is composite, 
*1f~is passed to the composite predicate application 
section (52), and lower predicates are recursively 
processed. Then, objects, with the result of true are 
tempo rarily saved as the search results. Ss au2L£gjL 

10 sultsjtre aJso"Teported tothe f older displa y section^ 
(93) so that tfiej nc^jouaro^iects as the search resu lt 
arj&xbaxigj&alfprjh^^ 

Jygjiligbtin§)= 

Figure 8 is conceptual diagram showing what 

15 happens when a predicate icon is dropped on an ob- 
ject to be searched. An object specified as a search 
range usually takes the form of a folder, which con- 
tains other objects therebelow. Then, the object to be 
contained may be a minimum and indivisible object 

20 such as a file (1', 2\ 3\ 4', 5*, and 6' in Figure 8), or 
a folder having further lower nests (FOLDER 1, and 
FOLDER 2 in Figure 8). When a predicate is applied 
to a folder subject to search, modes are considered 
where only files immediately below the folder subject 

25 to search are searched (the predicate is applied to 
only 1\ 2*. and 6' in Figure 8), and where, ifthe lower 
object is a folder, the lower object is also recursively 
searched (the predicate is applied to all of V, 2', 3', 4', 
5', and 6' in Figure 8). 

30 

D-4-2. Dropping of icon to be searched on 
predicate icon 

In this case, the object is applied to a predicate 
35 specified by dropping the object, and whether or not 
the subject object satisfies the predicate (that is, true 
or false) is obtained as output The object may be a 
collective database (that is, a folder), or a minimum 
and indivisible object (that is, a single file). If the ob- 
40 ject is a folder, it is attained in substantially the same 
operation as D-4-1. Therefore, description is made 
only for a case where the object is minimum and in- 
divisible (for the convenience, hereinafter the mini- 
mum and indivisible object subject to search being 
45 named and distinguished as an "object of applica- 
tion"). Figure 9 is a conceptual diagram showing the 
cooperative operation between the Predicate Manip- 
ulation System and the Window Manager in perform- 
ing a search in this case. The description is based on 
so the figure. 

First, the user drags and drops an object of appli- 
cation which becomes the search range on a predi- 
cate icon to which application is intended. Then, the 
drag & drop notification section (92) notifies the pre- 
ss dicate application sections (51 ) and (52) of the fact 
Ifthe predicate icon specified by dropping is com- 
posite, the composite predicate application section 
~(52)~f urther recursively reads a data block therebe- 
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low, and, w h en a primitive predicate is encountered , 
h as the primitive predicate application section (51) 
apply it Then, the primitive predicate application sec- 
tion (51) applies the primitive predicate to the object 
of to s ea rch, and returns a resu lt of true or false to the 5 
composite predicate application section (52 ). Then 
the composite predicate applica tion c*winn per- 
fo rms the logical opera ti on specified b y the type fiel d 
of the d ata block on all results of lower predicates re - 
cursively processed, and outputs its result. Then, if 10 
the predicate object is displayed as a folder on the 
desktop (that is, OPENed), it prompts the folder dis- 
play section (93) to change the display such as the 
background color depending on the result of true or 
false. In addition, if the predicate object is displayed is 
as an icon (that is, CLOSEd), it prompts the icon dis- 
play section (94) to change the display such as high- 
lighting of the icon of to application. 

Further, if the predicate icon specified by drop- 
ping is primitive, it applies a primitive predicate to the 20 
object of search and prompts the icon display section 
(94) to change the display such as highlighting of the 
predicate icon depending on the result of true or false. 

Jjfllirr <n te a conceptual diagram showing the 
operation when the object of application is dropped on 25 
the predicate icon. In this figure, individual predicates 
C1, C2, C 3 , and C 4 are nested for a composite predi- 
cate P as terms of a logical operation expression re- 
lated to P. When the object of application is applied to 
the composite predicate P, it is recursively applied to 30 
Ci, C 2 , C3, and C 4 (it is further recursively applied to 
a predicate having a nest such as C 1t and C 3 ). Then, 
each term C 1t ... returns to the composite predicate P 
a valujto f erther jrue or false as the result of applica- 
tion. Then, the composite predicate P perjojg^.ajog^. 35 
jcal operation corresponding its type for the result re- 
turned from each term. For example, if it is AND, it 
takes a logical product of the result of each term. That 
is, if a predicate C, is "false," P becomes "false," and 
if all predicates C, are "true," P also becomes "true." 40 
(Similarly, if it is OR or NOT, it takes a logical sum or 
logical difference.) Thus, as the result of application, 
the predica t e icon is highlignteo j according 10 inieor 
fajst Tfor the predicate . tfafolo^fTsclSpiayed by open- 
ing this icon, the nested lower predicate icons are 45 
highlighted according to true or false for the predicate 
icon. 

Although the present invention is described in de- 
tail with reference to a specific embodiment, it is ob- 
vious that those skilled in the art may alter or modify 50 
the embodiment. 

As described above in detail, the present inven- 
tion enables the user to identify a primitive predicate 
by inputting search items (that is, file attributes) on 
the desktop, and to create a logical operation expres- 55 
sion for identifying search conditions by displaying a 
composite predicate representing logical operators 
as a folder and by dragging and dropping an icon rep- 



resenting the predicate on the folder. In addition, the 
present invention provides excellent operability be- 
cause a predicate can be displayed on the desktop on 
a desired hierarchical level by opening or closing an 
icon for each composite predicate from an icon to a 
folder, or a folder to an icon. Then, a predicate can be 
applied as search conditions by dropping an icon rep- 
resenting the created predicate on a folder represent- 
ing a database (in this case, the dropped object of dis- 
play becomes the search range). Further, the predi- 
cate can be applied to the database by dropping an 
icon representing the database on a predicate icon (or 
folder). 

In other words, the present invention can provide 
a graphical user interface which can create a predi- 
cate for searching data only by a mouse on the desk- 
top, and which can apply the predicate to a database 
system. 



Claims 

1 . A graphical user interface implemented in a com- 
puter system (10), said computer system includ- 
ing a CPU (11), a display (13), a keyboard (14) for 
console input, a coordinate selection device (15), 
and storage (12) for storing and managing one or 
more objects, said computer system being load- 
ed with an operating system (16) for controlling 
the operation of said CPU and a Window Man- 
ager (17) supporting display of objects on said 
display, said graphical user interface comprising: 

(a) a predicate creation means (30) for creat- 
ing a predicate for searching for desired ob- 
jects in storage; 

(b) a predicate organization/storage means 
(40) for hierarchically organizing and storing 
predicates; and 

(c) a predicate application means (50) for ap- 
plying predicates to one or more objects in 
storage. 

2. A graphical user interface according to Claim 1, 
wherein said predicate creation means further 
comprises: 

(a) a primitive predicate creation means (31) 
for creating an indivisible primitive predicate 
containing one or more search items; and 

(b) a composite predicate creation means (32) 
for creating a composite predicate including a 
logical operation for one or more predicates. 

3. A graphical user interface according to Claim 2, 
wherein said predicate organization/storage 
means is arranged to organize and store one or 
more predicates in a form combining one or more 
logical operations, and to prepare a data block 
corresponding to each predicate created by said 
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primitive predicate creation means and said com- 
posite predicate creation means. 

4. A graphical user interface according to Claim 2 or 
Claim 3, wherein said predicate organ iza- 5 
tion/storage means is arranged to organize and 
store one or more predicates in a form combining 

one or more logical operations, and to store pre- 
dicates by hierarchically organizing them in such 
a manner that a second predicate, which is a 10 
composite predicate for forming logical opera- 
tions between first predicates, each of which is a 
primitive predicate or a composite predicate ob- 
tained from a previous logical operation on other 
predicates, already logically operated, is placed 15 
on a level immediately above the first predicate. 

5. A graphical user interface according to any one of 
Claims 2 to 4, wherein said predicate application 
means comprises: 20 

(a) a primitive predicate application means for 
applying a primitive predicate to the object in 
said storage; and 

(b) a composite predicate application means 

for applying a composite predicate to the ob- 25 
ject in said storage. 

6. A graphical user interface according to Claim 5, 
wherein said primitive predicate application 
means and said composite predicate application 30 
means operate in response to drag & drop notifi- 
cation via the mouse from said Window Manager. 

7. A graphical user interface according to Claim 6, 
wherein said composite predicate application 35 
means recursively calls lower predicates from 

said predicate organization/storage means, and 
causes said primitive predicate application 
means to perform an application when a primitive 
predicate is called. 40 

8. A graphical user interface according to any one of 
claims 2 to 7, wherein said primitive predicate 
creation means and said composite predicate 
creation means operate in response to drag & 45 
drop notification via the mouse from said Window 
Manager. 

9. Agraphical user interface according to any oneof 

the preceding claims, wherein said predicate ere- 50 
ation means is arranged to send to said Window 
Manager a command for displaying each predi- 
cate on the console. 
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